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Abstract. We study stable positive radially symmetric solutions for 
the Lane-Emden system — Au = v p in WL N , — Av = u q in WL N , where 
p,q > 1. We obtain a new critical hyperbola that optimally describes 
the existence of such solutions. 



1. Introduction 
We consider the Lane-Emden system 

{—Au = v p , u > in 
—At; = u q , v > in 



>• > 



where N > 1 and p > q > 0. Introduced independently by Mitidieri [T3] and 
Van der Vorst [21] , the Sobolev critical hyperbola plays a crucial role in the 
analysis of (11. ip . In particular, Mitidieri |15j (see also Serrin and Zou [18j ) 
proved that (jl.ljl has a nontrivial radially symmetric solution if and only if 
(p, q) lies on or above the hyperbola i.e. when 

/ x 1 1 2 

(1.2) + <1 . 

y ' p+1 q + 1 ~ N 

The Lane-Emden conjecture states that such a result should continue to hold 
for any positive solution (not necessarily radially symmetric). See Souplet 
[19j and the references therein for the progress on this conjecture. 

In this paper we characterize the stability of radially symmetric solutions 
of the Lane-Emden system (jl.ip . the definition of which we recall now. 

Definition 1.1. A solution (u,v) to is stable if there exists a positive 

supersolution of the linearized system i.e. if there exists (4>,ip) £ C 2 (R N ) 2 
such that 

' -A<j> > pv 9 ' 1 ^ inR N , 
-Ai>>qu q ~ 1 (l) inR N , 
0,V>O inR N . 

Let us also recall that if (11.21) holds, then 



(1.3) (u s ,v s ) = {a\x\- a ,b\x\-P), xeR N \{0} 

l 
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is a weak solution of (jl.ip provided 
(1.4) a = 2E±£, ?- 2{q+l) 



pq — 1 — 1 



i i 



anda = (STP)^ , 6 = (S q T)^ , S = a(N - 2 - a) , T = /3(N -2-/3). 

Our main result states that the stability of a radial solution of the Lane- 
Emden system is determined by the position of the exponents (p, q) with 
respect to a new critical curve, which we christen "Joseph and Lundgren", 
since the exponent introduced by these authors in is the intersection of 
the curve with the diagonal p = q . 

Theorem 1.2. Assume p > q > 1. 

(i) If N > 11 and (p,q) lies on or above the Joseph-Lundgren critical 
curve i.e. 

r(N - 2) 2 - (a- /3) 2 i 2 
(1.5) p > 4 {a P) \ >pqaP(N-2-a)(N-2-P), 

then any radially symmetric solution (u, v) of ( fi-J)) is stable and 
satisfies 

u < u s and v < v s in M. N \ {0}, 

where (u s ,v s ) is the singular solution given by (II. 3D and a, (3 are the 
scaling exponents given by (jl.4p . 

(ii) If N < 10 or if N > 11 and U.5\) fails, then there is no stable 
radially symmetric solution of (II. ip . 

Remark 1.3. Equation (jl.5p is derived by studying the stability of the sin- 
gular solution (u s , v s ) given by (jl.3p . 



Remark 1.4. 

• The above theorem was first proved by Cowan for 1 < N < 10, 
p > 9 > 2 and (tt,v) not necessarily radial. See [3]. 

• In the case p = q, using Remarks 1.1(a) and 2.1(a) of Souplet fl~9] 
and Farina's seminal work for the case of a single equation [9], part 
(ii) of the theorem readily follows. The result continues to hold for 
possibly nonradial solutions, assumed to be stable only outside a 
compact set. 

• In the biharmonic case q = 1, the theorem was first proved by Kara- 
georgis [13] using the asymptotics found by Gazzola and Grunau in 

n 

• In all the other cases, only partial results were known. To the authors 
knowledge, the state of the art for nonradial solutions is contained 
in the following references: Wei and D. Ye [23], Wei, Xu and Yang 
[22], Hajlaoui, A. Harrabi and D. Ye [10] for the biharmonic case, 
and Cowan [4] for the general case. We believe that the methods of 
the paper [8] by Goubet, Warnault and two of the authors should 
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Figure 1. The stable region (shaded) for radially symmetric 
solutions of the Lane-Emden system ([1.1ft . 



slightly improve the known results (and coincide with [10] in the 
biharmonic case). 

• Our result does not cover the case where one of the exponents is less 
than 1. 

• The left hand-side in fjl .5[) is related to the following Hardy-Rellich 
inequality : 



(1.6) 



(1.7) 



|2-7 



\Aip\ 2 dx > C 1 [ 



2 ~\ 2 dx. 



The optimal constant C 7 in the class of radially symmetric functions 
(p = <p{\x\) is given by 



( 



inf 

<p£C™(WL N \{0}) 
0^=ip(\x\) 



X 



2-7 



\A(p\ 2 dx 



x 



- 2 ~^ 2 dx 



{N-2) 2 - 7 2 i2 



and the above infimum is never achieved. See Caldiroli and Musina 
[2]. We remark that the optimal constant C 7 in (jl.7p corresponds to 
the left hand-side in p3|) with j = a — ft E [0, 2). 

As an immediate corollary of Theorem 1 1 . 2 1 and standard blow-up analysis, 
we obtain the following regularity result. 
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Corollary 1.5. Let B denote the unit ball of M. N , N > 1, X,/j, > 0. Let 
f,g £ C 1 (IR) be two nondecreasing functions such that /(0) > ; g(0) > ; 
f'(0)g' (0) > and 

lim ~ — ~r = a, lim - = 6 

/or some a, b > 0, p > q > 1, pq > 1. Then, any extremal solution to the 
system 

' -Au = Xf(v), u>0 inB, 
(1.8) < -Av = fig(u), v > in B, 

u = v = on (9i? 

v 

is bounded if either N < 10 or if N > 11 and (p, o) /ies below the Joseph- 
Lundgren critical curve i,e, (ll.5|) /ai/s. 

For the notion of extremal solution for systems, we refer to Montenegro 
[16j . See also Cowan [3] for partial results on general domains. The proof is 
a straightforward adaptation of Theorem 1.8 in [5], using the version of the 
blow-up technique introduced by Polacik, Quittner and Souplet [17], so we 
skip it. 

2. Preliminary Results 

The following three results will serve for the purpose of comparing so- 
lutions. In the lemma below, we say that a solution is strictly stable in a 
bounded region f2 C M N if the principal eigenvalue of the linearized equation 
with Dirichlet boundary conditions in Q is strictly positive. 

Lemma 2.1. Let (u, v) 6 C 2 (M. N ) 2 be a stable solution of Then, given 

any bounded domain Q C IR , (u, v) is strictly stable in Q. In particular, 
the linearized operator satisfies the maximum principle, that is, any pair 
O,V0 G C 2 (Tl) 2 such that 

-Acf> > pv p ~~ 1 ip in Q, 

-Aip > qu^ 1 ^ in f2, 

<j>,ij) > on 30, 

satisfies (J), tp > in f2. 

Proof. Since (u, v) is stable in R , the linearized equation has a strict su- 
persolution in f2. As observed by Sweers [20] and Busca-Sirakov [I], this 
implies in turn that the principal eigenvalue of the linearized operator with 
Dirichlet boundary conditions in is strictly positive and equivalently that 
the maximum principle holds. □ 



In the next lemma, we say that a solution is minimal if it lies below any 
(local) supersolution of the same equation. See e.g. [7] for the notion of 
minimal solution. 
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Lemma 2.2. Assume p > q > 1 and let Q C 1^ be a bounded domain, 
a, b G C(<9$7) ; a, b > 0. If (u,v) 6 C 2 (f2) 2 zs a strictly stable solution of 

' —Au = v p in Q, 

(2.1) ^ -An = -u 9 m fl, 

u = a(x) , v = b(x) on c?S7, 

then (u, v ) is minimal. 

Proof. Assume that (u, v ) is a strictly stable solution of (|2.ip . By the max- 
imum principle, 

u > mina , f > min 6 in VL. 

an an 

In particular, there exists the minimal solution (u m ,v m ) of (HH) and 
u > Mm > min a , u > v m > min b in $7. 

Set (6 ip = v — v m . Then, 0, ^ > in and, since p > q > 1, 

f -A<£ = v p - v p m < pv^tp in n, 

-At/) = u q -u q m < qu q ~ l (j) in tt, 
(p = ijj = on 9fi. 

Since (it, v ) is strictly stable, the maximum principle holds and implies that 
<j), ip < in Q. It follows that (f> = tp = 0, that is, u = ii m and v = v m . □ 

As an immediate consequence of the two previous lemmas, we obtain 

Corollary 2.3. Let (u,v) G C 2 (R N ) 2 be a stable solution of ( TP]) and let 

(u s ,v s ) be the singular solution defined by il.3\) . If there exists R > such 
that u(R) < u s (R) and v(R) < v s (R), then 

u < u s and v < v s in Br \ {0}. 

Proof. Since u s (0) = v s (0) = oo, there exists r € (0, R) such that 

(2.2) u < u s and f < f s in _B r \ {0}. 

We next apply Lemma [2T21 for £2 = Br\B t , a(x) = u, b(x) = v. Thus (u, v) 
is the minimal solution of (|2.1[) and u < u s , v < v s in \ B r . This last 
inequality together with (|2.2p yield the conclusion. □ 

2.1. Stability of the singular solution. In this part we investigate the 
stability of the singular solution (u s ,v s ) given by ()1.3|) . 



Proposition 2.4. The following are equivalent: 

(i) The singular solution (u s ,v s ) is stable in M. N \ {0}; 

(ii) The singular solution (u s ,v s ) is stable outside of some compact set; 
(hi) (p, q) satisfies 111.5]) . 



6 W. CHEN, L. DUPAIGNE, AND M. GHERGU 

Proof. Since the implication (i)=>(ii) is trivial, we only need to prove the 
implications 

(ii) => (iii) => (i) 

Assume first that (ii) holds, that is, the singular solution (u s ,v s ) is stable 
outside of a compact set. Thus, (u s ,v s ) is stable in M N \ B r for some r > 0. 
By scale invariance, (u s ,v s ) is stable in \ B p for all p > 0. 

Set 7 = a — (3, where a, (3 are the scaling exponents given by (|1.4p and 
let Ki,K2 be the constants such that 

pyP- 1 = Kx\x\- 2+ ^ and qu q ~ l = i^M" 2 " 7 - 

Then, (p, q) satisfies (|1 .5j) if and only if 

C 7 > K X K 2 , 

where C 7 is given by (ll.7p . Assume by contradiction that (p, q) does not 
satisfy (|1.5p . Then, we may find an open annular region = Br ± \ Br 2 such 
that 

f \x\ 2 ~^\Ap\ 2 dx 

(2.3) A := min % < K X K 2 , 

#*\{0} f ^1-2-7^2^ 

where H is the space of radial functions p such that |x| 2_7 |A9?| 2 (i:z; < +oo 
and (p = on 30. Let </? > be a minimizer of (12 .3p . so that letting 
ip = |x| 2_7 (— Ap), we have 

-Ap = \x\~ 2+ ^ip, 9? > in O, 

-Aip = A|xj" 2 ~ 7 v?, V > in n, 
p = ip = on <9il. 

Since (u s ,v s ) is strictly stable in O, thanks to |2CH Theorem 1.1], there also 
exists (<p,ip) € C 2 (0) 2 such that 

-A<p> = Ki|x|~ 2+7 ^, > in n, 

-Ai> = K 2 \x\- 2 -^(p + 1, i> > infi, 

ip = ip = on (90. 

A straightforward integration by part shows that ip and (/3 satisfy 



(ip, <p) := / |x| 2 ~ 7 A^A(^(ix < 



which is impossible, since both ip and ip are positive. Hence (p, q) satisfies 
(jl.5p and we have proved that (ii) implies (iii). 
Assume now (iii). It is easy to see that 

4K{ _ N-2 — i _ JV-2+7 

(2-4) <^)= (Ar _ 2 _ 7)(jV _ 2 + 7) H- 2 , ^(x) = \x\- . 
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(3.1) 



satisfy 

-A6 = pv p ~ l ^b 

(2.5) 

-AiP > qu q - l 4> 

in M. N \ {0}, which means that (u s ,v s ) is stable in W N \ {0}. □ 

3. Proof of Theorem 11.21 
We start this section with the following simple remark. 
Remark 3.1. Let (u,v) be a radially symmetric solution of Then 

lim u(r) = lim v(r) = 0. 

To see this, we first note that (u, v) satisfies 

J -{r N ' X u')' = r*"~V for all r > 0, 

\ -(r^-y)' = r^V for all r > 0. 

This implies that r i — > r Ar_1 u / (r) and r i — > r N ~ 1 v'(r) are decreasing on 
[0, oo) and so u',v' < in [0, oo). Thus, u and v are decreasing in [0, oo). 
Hence, there exist 

i\ := lim u{r) € [0, oo) , £2 ■= lim v(r) € [0,oo), 

r— >oo r— >oo 

and n > £±, v > ti in [0, 00). 

If £2 > 0, then, the first equation in (|3.ip implies 

-{r N - l u')' > Cr^ 1 for all r > 0, 

where C = £ v 2 > 0. Integrating twice over [0, r] in the above inequality we 
deduce 

C 

—u(r) + u(0) > l^ 7 " 2 ~ * 00 as r — > 00, 

contradiction. Thus, £2 = and similarly £\ = which proves our claim. 

Assume (p, g) satisfies (|1.5p . Then by Proposition 12. 4| the singular solu- 
tion (u s ,v s ) is stable in M. N \ {0}. 

Theorem II. 2( i) follows from the proposition below. 

Proposition 3.2. Assume (p,q) satisfies ( 11.5)) . Then, for any radially sym- 
metric solution (it, v) of we have 

(3.2) u < u s and v < v s in R N \ {0}. 

Proof. Assume by contradiction that there exists a radially symmetric solu- 
tion (it, v) of (ll.ip for which (I3.2p fails to hold and set 

U = u s — u , V = v s — v. 

Since (13. 2j) is not fulfilled, J7' and V' must change sign in (0, 00). Indeed, 
otherwise U' < or V' < in (0, 00) which implies (since U(oo) = V(oo) = 
0) that u s > u or v s > v in (0, 00). Now, the maximum principle yields 
u s > u and v s > v in (0, 00) and this contradicts our assumption. 
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Let r\ > (resp. r 2 > 0) be the first zero of U' (resp. V). Thus 
U' < in (0, n), U'{n) = 0, V < in (0, r 2 ), V r/ (r 2 ) = 0. 
Without losing the generality, we may assume r 2 >r±. Set next 

r 3 := inf {r > : V(r) < 0} € (0, oo] 
and we claim that r 3 <r\. If r 3 > ri then V > in (0, ri) which means 

(3.3) v < v s in (0, r\). 
Integrating in (jl.ip and using (13. 3|) we find 

(r iV " 1 u')' = -r N ~ l v p > -r N - l v? = (r^V,)' in (0, n). 

Integrating the above inequality over [0, r±] we find v!{r\) > u' s (r\) which 
contradicts U'(r\) = 0. Hence r 3 E (0, r±). Similarly we define 

r 4 := inf{r > : U{r) < 0} € (0, oo] 

and as before we deduce r 4 G (0,r2). In fact, we show that r 4 < n. As- 
suming the contrary, that is, r 4 > n, we find n < r 4 < r 2 . Further, since 
V < in (0, r 2 ) we deduce V(r) < V(r 3 ) = for all r E (?" 3 ,r 2 ) so v s < v 
in (r 3 ,r 2 ). Therefore, 

(r^-V)' = -r^" 1 / < -r^- 1 ^ = (r^ 1 ^)' in (r 3 ,r 2 ). 

Integrating over [ri,r], r\ < r < r 2 , and using U'(r{) = we obtain u'(r) < 
u' s (r) for all r G (?1,r 2 ). This means that J7 is increasing in (ri,r 2 ). In 
particular, U(r\) < f/(r 4 ) = 0. On the other hand, from the definition 
of r 4 we have U(r\) > 0, contradiction. We have thus obtained r 3 < n, 
r 4 < r i < r 2 which yield 

(3.4) c/(n) < o, tf'(n) = o, v(n) < o, v'(n) < o. 

Next, let (<f>, ip) be defined by (|2.4p and recall that (<^>, ■0) solves the linearized 
equation ([23]) in M w \ {0}. Also, since p > q > 1, (£7, V) satisfies 

(3.5) I ~ 1 inR" \{0}. 
\ -Ay < qu^U 

We multiply the equations in (]2.5f) by 1/ and [/, and the two equations in 
(|3.5p by and (/> respectively. Integrating over B r , r > 0, we find 

(-AU)i(> < I (-Acj))V and / (-AV)^ < / (-Ai(>)U. 

J By J Br " Bf 

Adding the above inequalities we deduce 

VAcj) - 0Av) + J (lIAtp - if>AUj < for all r > 0, 



that is, 



f ( v **-M.) + f (u^-i,f)<0 forallrX). 
JdB r v ov dvJ J dBr \ dv duJ 
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Since U, V, <f>, ip are radially symmetric, this yields 

(3.6) V<t>' - <j)V' + Uip' - ij)U' < in (0, oo) . 

Now, let us remark that <p, ip > and (f>',ip' < in (0, oo). Combining this 
fact with fj3.4j) we deduce that (|3.6p does not hold ar r = r\, a contradiction. 
Hence u < u s and v < v s in M. N \ {0}. □ 

Assume next that (|1 . 5[) fails to hold. We establish first the following 
result. 

Proposition 3.3. Assume (p, q) does not satisfy M.5\) . Then, for any stable 
solution (u, v) of A 1.1]) we have 

u < u s and v < v s in M. N \ {0}. 

Proof. Assume by contradiction that u — u s changes sign in M. N \ {0}. Then 
v — v s also changes sign in R \ {0} for otherwise v — v s < in 1^ \ {0} 
implies 

-A(u - u s ) = v p - v p s < in R N \ {0}. 
Also u — u s < in a neighborhood of the origin and by Remark 13.11 we 
have u(x) — u s (x) —¥ as \x\ — > oo. By the maximum principle, we deduce 
u — u s < in M. N \ {0} which contradicts our assumption. 

Hence u — u s and v — v s change sign on (0, oo). Denote by r\ (resp. r2) 
the first sign-changing zero of u — u s (resp. v — v s ). Prom Corollary 12. 3} 
u — u s (resp. v — v s ) cannot be zero in a whole neighborhood of r\ (resp. 
r-i). Without losing generality, we may assume that r\ <r2- 

We claim that u — u s has a second sign-changing point r$ > r-y. Indeed, 
otherwise u—u s > in M. N \B ri which by the maximum principle implies that 
v — v s > in M. N \ B r2 . Therefore, u > u s , v > v s in M. N \ B r2 which implies 
that (u s ,v s ) is a stable solution of (jl.ip in ~R N \ B r2 and thus, contradicts 
Proposition 12.41 Hence, there exists r^ > r\ a second sign-changing point 
of u — u s . Further, we must have r^ > r2 for otherwise r\ <r^ < r2- Then 
^(^3) = u s {rz) and v(rs) < v s (rs) which by Corollary 12.31 yields u < u s , 
v < v s in B r:j \ {0}. But this is impossible since u(r\) = u s {r\). Thus, 
r 3 > r 2 . 

We next claim that v — v s has a second sign-changing point r^ > As 
before, if this is not true, then v — v s > in 1^ \ B r2 and by the maximum 
principle we find u — u s > in W N \ B r3 . Then u > u s , v > v s in Hl N \ B r3 , 
so (u s ,v s ) is stable in W N \ B r3 which contradicts Proposition 12.41 

We show next that r^ > r%. Assuming the contrary we have r 2 < r^ < 
At this stage, two cases may occur: 

Case 1: v <v s in (r4,r3). Remark that u(r^) = u s (rs) and vfa) < v s (r3). 
By Corollary 12.31 we deduce u < u s in B r3 which is impossible since u{r\) = 
u s (ri). 

Case 2: v — v s has a third sign-changing point p £ (r^, r^). Then v — v s > 
on (r 2 , r4) and v — v s < on (r^, p). On the other hand, 

-A(v - v a ) = u q - u q s > in B p \ B rA 
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and v — v s = on d(B p \ B r4 ). The maximum principle yields v — v s > on 
(r4,p), a contradiction. We have proved that > r^. 

We claim that u — u s has a third sign-changing point r§ > r%. Indeed, if 
this is not true, then u — u s < in 1^ \ B rs and by the maximum principle 



we have v — v s < in \ B r4 . Hence u < u s , v < v s in M. N \ B r4 which 
combined with Corollary 12.31 produces u < u s , v < v s in B ri . This is clearly 
impossible since u(r\) = u s (ri). Hence, u — u s has a third sign-changing 
point rs > r%. 
If rs < r4 then 

-A(n - u a ) = v p - v p s > in B r5 \ B ra 

and u — u s = on d(B rs \ B r3 ). By the maximum principle we infer that 
u — u s > in B rs \B r3 which implies u — u s > in B rs \B ri . This contradicts 
the fact that r 3 E (ri, r 5 ) is a sign-changing point of u — u s . 

If rs > r4 then u(r4) < u s (r4) and v(r4) = v s (r4). By Corollary 12.31 we 
deduce u < u s , v < v s in B rA which is again a contradiction. □ 



We are now ready to complete the proof of Theorem 11.2( h) . We adapt 
an idea introduced in [Bj. Assume there exists a positive stable radially 
symmetric solution (it, v) of (jl.ip and set 

Mi = sup — > M 2 = sup 



rG(0,oo) u sl r J re(0,oo) u sl r J 

By Proposition 13. 31 we have M\, Mi < 1. S n(r) = 0, n coincides 

with the Newtonian potential of v p . Hence 

u(x) = c N \x- y\ 2 ~ N v p (y)dy 



< Ml ic N [ \x- y\ 2 - N v p (y)dy) = M p u s (x). 

Thus, Mi < Mf and similarly M 2 < . It follows that M x < M{ q . So, 
since pq > 1 we have either Mi = or Mi = 1. If Mi = then u = 
and this yields v = which is impossible. Therefore Mi = 1 and similarly 
M 2 = 1, i.e. 

u(r) v(r) 
sup — - - = sup — - = 1. 

r6(0,oo) U s {r) re(0,oo)^( r ) 

By the strong maximum principle, (u, v) cannot touch (u s ,v s ), so there 
exists a sequence {Rk} converging to +oo such that 

(3-7) hm = 1. 

fe->oo U s {Kk ) 

Define 

u k (r) = R%u(R k r) , v k (r) = R P k v{R k r) r > 0. 
By scale invariance we have 

(3.8) < u k < u s , < v fc < t> s in R N \ {0} 
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and (uk,Vfs) solves the Lane-Emden system (jl.ip in M. N \ {0}. By elliptic 
regularity, {(uk, v k )} converges uniformly in Cf 0C (M. \ {0}) to a solution 
(u, v) of (jl.ip which, in view of (|3.8p . also satisfies 

0<u<u s , 0<v<v s inR N \{0}. 

Let us remark that by (|3. T[) we have 

5(1) = lim u k {l) = lim R a k u(R k ) = lim R a k u s {R k ) = u s (l). 

k— >oo k— ¥oa k— >oa 

On the other hand, 

( -A(u-u s ) =¥> -v p s < inK^^O}, 

| lim (u — u s ) < , lim (u — u s ) < 0. 
I \x\— >0 \x\— i-oo 

By the strong maximum principle we deduce that u = u s in M. N \ {0}. This 
is impossible, since u is a stable solution by construction while u s is unstable 
when (jl.5p fails. 
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